A Combinatorial Design for Cascaded Coded Distributed Computing on General Networks

نویسندگان

چکیده

Coding theoretic approaches have been developed to significantly reduce the communication load in modern distributed computing system. In particular, coded (CDC) introduced by Li et al. can efficiently trade computation resources MapReduce like systems. For more general cascaded CDC, Map computations are repeated at r nodes among tasked with Q Reduce functions s times. this paper, we propose a novel low-complexity combinatorial design for CDC which 1) determines both input file and output function assignments, 2) requires less number of files functions, 3) operates on heterogeneous networks where varying storage capabilities. We provide an analytical characterization computation-communication tradeoff, from show proposed scheme outperform state-of-the-art homogeneous networks. Further, when network is heterogeneous, that performance be better than its counterpart. addition, optimal within constant factor information converse bound while fixing assignments.

منابع مشابه

A New Combinatorial Design of Coded Distributed Computing

Coded distributed computing introduced by Li et al. in 2015 is an efficient approach to trade computing power to reduce the communication load in general distributed computing frameworks such as MapReduce. In particular, Li et al. show that increasing the computation load in the Map phase by a factor of r can create coded multicasting opportunities to reduce the communication load in the Reduce...

متن کامل

Coded Computing for Distributed Graph Analytics

Many distributed graph computing systems have been developed recently for efficient processing of massive graphs. These systems require many messages to be exchanged among computing machines at each step of the computation, making communication bandwidth a major performance bottleneck. We present a coded computing framework that systematically injects redundancy in the computation phase to enab...

متن کامل

Analysis and design of a CMOS current reused cascaded distributed amplifier with optimum noise performance

In this paper, analysis, simulation and design of a distributed amplifier (DA) with 0.13µm CMOS technology in the frequency range of 3-40 GHz is presented. Gain cell is a current reused circuit which is optimum in gain, noise figure, bandwidth and also power dissipation. To improve the noise performance in the frequency range of interest, a T-matching low pass filter LC network which is utilize...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Communications

سال: 2021

ISSN: ['1558-0857', '0090-6778']

DOI: https://doi.org/10.1109/tcomm.2021.3087788